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Abstract — Due to space limitations, our submission "Source 
Separation and Clustering of Phase-Locked Subspaces", accepted 
for publication on the IEEE Transactions on Neural Networks 
in 2011, presented some results without proof. Those proofs are 
provided in this paper. 

Index Terms — phase-locking, synchrony, source separation, 
clustering, subspaces 



Appendix A 
Gradient of in RPA 

In this section we derive that the gradient of jgip is given by 
Eq. 6 of [1], where \g\is defined as in Eq. 5 of [JJ. Recall that 
A(j){t) = (j>{t) — tp{t), where (j){t) is the phase of the estimated 
source y{t) = w'^x{t) and ip{t) is the phase of the reference 
u{t). Further, define g = |g|e'*. 

We begin by noting that |ep = cos(<i>))^ + (|e| sin($))2, 
so that 

V|e|2 = V(|e| cos($))2 + V(|g| sin($))2 

= 2\g\ [cos($)V(|6i| cos($)) + sin($)V(|6i| sin($))] . 

Note that we have y cos(A0(t))) = |gi|cos($) and 

T ELi sin(A0(t))) = \g\ sin($), so we get 



y\g\^ = 2\g\ { cos($)V 



iX]cos(A0(i))) 



sin($)V 



T 



i^sin(A^(t))) 



M 

T 



T 



1 

^ |^sin($)cos(A(?!)(t)) - cos($) sin(A0(t)) 
t=i 

T 

^sin[$ - A0(i)]VA0(i). 
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Let's now take a closer look on VA(/)(i). Note that 



(f){t) ~ arctan 
<f>{t) = arctan 



wTx(t) 

wTx(t) 



or 



Because of this we can say, if w^x(t) ^ 0, that V0(t) = 
V arctan ^ ^t^^^*'' ^ ■ On the other hand, since A(/)(<) = (j){t) — 
tp{t) and ip{t) does not depend on w, we have (we will omit 
the time dependence for the sake of clarity): 



VAcf) = Vc/) - VV^ = V(j!) = V arctan 



Xh • W X 



X • W^Xh 



w''"xh 



where ¥"^{1) ~ (w^x(t))^ + (w^Xh(t))^ is the squared 
magnitude of the estimated source, and T ^(t) = Xh(t)x^(/:) — 
x(t)xhT(0, thus r,.^(t) = X,{t)Xj{t)A^{<l>i{t) - <t>j{t)). 
We can now replace VA(t){t) in ([T]i to obtain 
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Appendix B 
Gradient of Ji in IPA 

In this section we show that the gradient of J/ in Eq. 7 of 
fll is given by Eq. 8 of Qj. Throughout this whole section, 
we will omit the dependence on the subspace I, for the sake 
of clarity. In other words, we are assuming (with no loss of 
generality) that only one subspace was found. Whenever we 
write W, y, y,n or z, we will be referring to W/, y/, (y;)^ 
or Z;. 

The derivative of log|detW| is W^^. We will therefore 
focus on the gradient of the first term of Eq. 7 of UJ, which 
we will denote by P: 



P = 

Let's rewrite P as P 

Define A4>rnn = 4>m - 
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IV^ Sm,n-P"in with p,„„ — Iftrmp. 

I. Omitting the time dependency, we 
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have 

= \0mn\ X (^{c08{A(t)mn)y + i( sin(A0„„)) 

X 2(cos(A0„„))Vw,(cos(A0,„„)) + 
+ 2( sin(A0„„)) ( sin(A0„„)) 
= 2|ft„„||(e''^*"")f'x 

X - ( cos(A0„„)){^ sin(A(?!)™„)Vw,- A(/)™„) + 
+ ( sin(A0„„))( cos(A(?!)„„)Vw,- A0„ 



-1/2 
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where we have interchanged the partial derivative and the time 
average operators, and used 

1/2 

((cos(A</)„„0)' +i(sin(A<^™„))') = |(e*'^^"")| - 

Since 0m is the phase of the m-th measurement, its deriva- 
tive with respect to any Wj is zero unless m — j or n = j. 
In the former case, a reasoning similar to Appendix |A] shows 
that 



_ [Zh • Z - Z • Zh] • Wj _ • Wj 
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where Fzit) = Zh{t)z^{t) — z(t)zh^(<). It is easy to see 
that VwjA^jfc = -V^.A(j)kj- Furthermore, p,„,„ = 1 by 
definition, hence Vw Pmm = for all m and j. From these 
considerations, the only nonzero terms in the derivative of P 
are of the form 



-(cos(A(/)jfc)) / siii(A0jfc)-"^^ 



+(sin(A(/ijfc)) /cos(A(?!)jfc)-"^'' "^-^ 



(5) 



We now define ^'o j. 



'jfc = = {^(t)jk)- Plugging in 

this definition into Eq. (|5]) we obtain 

'^wjPjk = 2|ejfe|x 

cos(*,fe) ^siii(A0,fc) ^y ^ + 

+ sin(^'jfc) (cos{A(f>jk)^' ' 



( - COS sm A0jfc — p^-^ 
sm WjTj cos A(/)j7j- 



where we again used siii(a — 6) = sin a cos h — cos a sin h in 
the last step. Finally, 
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fc=l ^ 
which is Eq. 8 of [I]. 



Appendix C 
Gradient of J in pSCA 

In this section we derive Eq. 10 of |r| for the gradient of 
J. Recall that J is given by 
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where the Wkj are real coefficients that we want to optimize 
and the Vik are fixed complex numbers. Also recall that Re(.) 
and Im(.) denote the real and imaginary parts. 

We begin by expanding the complex absolute value: 
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When computing the derivative in order to Wkj , only one term 
in the leftmost sum matters. Thus, 

dJ 



dwkj 
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In the sums inside the derivatives, the sum on k can be 
dropped as only one of those terms will be nonzero. Therefore, 
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where we used Vi = J^k "^ki to denote the sum of the i-th 
column of V. Similarly, 



d Im 



Im(vfc) , 



dwkj 

These results, with the notation Uj = J2k ^ifc °f 
the j-th column of U, can be plugged into Eq. ^ to yield 

dJ I r _ _ _ _ ' 

Gfej = = Re(wfc) X Re{uj) + lm{vk) x lm{uj) . 

OWkj \Uj \ L J 

Appendix D 
Mean field 

In this section we derive Eq. 9 of [Tl for the interaction 
of an oscillator with the cluster it is part of. We will assume 
that there are Nj oscillators in this cluster, coupled all-to- 
all with the same coupling coefficient k, and that all inter- 
cluster interactions are weak enough to be disregarded. We 
begin with Kuramoto's model (Eq. 1 of 0]) omitting the time 
dependency: 

(^i = + ^ Kjfe sin(0fc - 4) + ^ sin((/)fe - cj),) 
(j>i=uji+^ K,k sin(0fc - 4) 

gi(0j-0i) _ g-i(03-<^i) 



l^ik ' 



2i 



kEcj kGcj 

We now plug in the definition of mean field Qc e^""^ — 
W- J^kec, e'*" to obtain 

= UJ, + NjKQc- [sin($cj - (pi) - sm{<j), - 
= uji + 2NjKQcj sin($cj - 4>i)- 
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